Pandas Profiling Report

Dataset statistics

Number of variables	15
Number of observations	1094942
Missing cells	8576417
Missing cells (%)	52.2%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	125.3 MiB
Average record size in memory	120.0 B

Variable types

Numeric	11
DateTime	2
Categorical	2

Alerts

`department_name` has a high cardinality: 439 distinct values	High cardinality
`height` has a high cardinality: 1081 distinct values	High cardinality
`bp_systolic` is highly correlated with `bp_diastolic`	High correlation
`bp_diastolic` is highly correlated with `bp_systolic`	High correlation
`bp_systolic` is highly correlated with `bp_diastolic`	High correlation
`bp_diastolic` is highly correlated with `bp_systolic`	High correlation
`bp_systolic` is highly correlated with `bp_diastolic`	High correlation
`bp_diastolic` is highly correlated with `bp_systolic`	High correlation
`admit_date` has 51036 (4.7%) missing values	Missing
`discharge_date` has 225126 (20.6%) missing values	Missing
`bp_systolic` has 1027569 (93.8%) missing values	Missing
`bp_diastolic` has 1027573 (93.8%) missing values	Missing
`temperature` has 1038715 (94.9%) missing values	Missing
`pulse` has 1033939 (94.4%) missing values	Missing
`weight` has 1003189 (91.6%) missing values	Missing
`height` has 1052611 (96.1%) missing values	Missing
`respirations` has 1064041 (97.2%) missing values	Missing
`inches` has 1052611 (96.1%) missing values	Missing
`primary_disease_id` is highly skewed (γ1 = 30.89429801)	Skewed
`encounter_id` is uniformly distributed	Uniform
`encounter_id` has unique values	Unique

Reproduction

Analysis started	2021-11-26 18:02:07.908771
Analysis finished	2021-11-26 18:03:11.420783
Duration	1 minute and 3.51 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

encounter_id
Real number (ℝ_≥0)

UNIFORM
UNIQUE

Distinct	1094942
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	547471.5

Minimum	1
Maximum	1094942
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	1
5-th percentile	54748.05
Q1	273736.25
median	547471.5
Q3	821206.75
95-th percentile	1040194.95
Maximum	1094942
Range	1094941
Interquartile range (IQR)	547470.5

Descriptive statistics

Standard deviation	316082.6736
Coefficient of variation (CV)	0.5773500055
Kurtosis	-1.2
Mean	547471.5
Median Absolute Deviation (MAD)	273735.5
Skewness	-2.227028639 × 10^-17
Sum	5.994495392 × 10¹¹
Variance	9.990825653 × 10¹⁰
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2049	1	< 0.1%
59062	1	< 0.1%
5800	1	< 0.1%
7849	1	< 0.1%
1706	1	< 0.1%
3755	1	< 0.1%
13996	1	< 0.1%
16045	1	< 0.1%
9902	1	< 0.1%
11951	1	< 0.1%
Other values (1094932)	1094932	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%
10	1	< 0.1%

Value	Count	Frequency (%)
1094942	1	< 0.1%
1094941	1	< 0.1%
1094940	1	< 0.1%
1094939	1	< 0.1%
1094938	1	< 0.1%
1094937	1	< 0.1%
1094936	1	< 0.1%
1094935	1	< 0.1%
1094934	1	< 0.1%
1094933	1	< 0.1%

patient_id
Real number (ℝ_≥0)

Distinct	36156
Distinct (%)	3.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	49523.04568

Minimum	1
Maximum	99996
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	1
5-th percentile	4963
Q1	25535
median	49457
Q3	73399
95-th percentile	95272
Maximum	99996
Range	99995
Interquartile range (IQR)	47864

Descriptive statistics

Standard deviation	28588.64598
Coefficient of variation (CV)	0.5772796399
Kurtosis	-1.154105701
Mean	49523.04568
Median Absolute Deviation (MAD)	23933
Skewness	0.03181392522
Sum	5.422486268 × 10¹⁰
Variance	817310678.9
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
61560	4042	0.4%
36478	3313	0.3%
95593	2701	0.2%
67141	2322	0.2%
41331	2041	0.2%
27152	1902	0.2%
19898	1795	0.2%
34156	1622	0.1%
21427	1607	0.1%
72055	1496	0.1%
Other values (36146)	1072101	97.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	3	< 0.1%
3	15	< 0.1%
8	18	< 0.1%
10	9	< 0.1%
13	5	< 0.1%
14	44	< 0.1%
17	20	< 0.1%
18	1	< 0.1%
24	24	< 0.1%
26	42	< 0.1%

Value	Count	Frequency (%)
99996	38	< 0.1%
99994	143	< 0.1%
99989	165	< 0.1%
99988	1	< 0.1%
99986	4	< 0.1%
99984	38	< 0.1%
99980	16	< 0.1%
99979	1	< 0.1%
99978	1	< 0.1%
99977	5	< 0.1%

admit_date
Date

MISSING

Distinct	1029849
Distinct (%)	98.7%
Missing	51036
Missing (%)	4.7%
Memory size	8.4 MiB

Minimum	1950-11-08 20:17:55.553000
Maximum	2012-06-18 16:16:18.833000

Histogram

Histogram with fixed size bins (bins=50)

discharge_date
Date

MISSING

Distinct	828469
Distinct (%)	95.2%
Missing	225126
Missing (%)	20.6%
Memory size	8.4 MiB

Minimum	1950-11-09 18:59:55.553000
Maximum	2010-08-21 22:00:51.647000

Histogram

Histogram with fixed size bins (bins=50)

department_name
Categorical

HIGH CARDINALITY

Distinct	439
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	8.4 MiB

DOL-DEFAULT ORDERING L	712137
PHN-PHONE	30300
STUDENT HEALTH SERVICE	23785
FCC FAMILY MEDICINE	15855
FCC INTERNAL MEDICINE	15225
Other values (434)	297640

Length

Max length	46
Median length	22
Mean length	19.68628475
Min length	2

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	24 ?
Unique (%)	< 0.1%

Sample

1st row	ETC
2nd row	ETC
3rd row	HOSP DENTISTRY
4th row	BT4OB-OB GYN CLINIC
5th row	BT4OB-OB GYN CLINIC

Common Values

Value	Count	Frequency (%)
DOL-DEFAULT ORDERING L	712137	65.0%
PHN-PHONE	30300	2.8%
STUDENT HEALTH SERVICE	23785	2.2%
FCC FAMILY MEDICINE	15855	1.4%
FCC INTERNAL MEDICINE	15225	1.4%
EYE CLINIC	11253	1.0%
ETC	9420	0.9%
CLINICAL CANCER CENTER	9075	0.8%
PSY ADULT PSYCHIATRY CLINIC	8970	0.8%
NOT ASSIGNED	8916	0.8%
Other values (429)	250006	22.8%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
dol-default	712137	23.5%
l	712137	23.5%
ordering	712137	23.5%
clinic	71070	2.3%
medicine	34607	1.1%
health	33889	1.1%
fcc	33120	1.1%
phn-phone	30300	1.0%
rad	30266	1.0%
service	23785	0.8%
Other values (475)	640713	21.1%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

age
Real number (ℝ)

Distinct	95
Distinct (%)	< 0.1%
Missing	7
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	44.83028325

Minimum	-3.13
Maximum	90
Zeros	0
Zeros (%)	0.0%
Negative	2
Negative (%)	< 0.1%
Memory size	8.4 MiB

Quantile statistics

Minimum	-3.13
5-th percentile	17
Q1	30
median	45
Q3	58
95-th percentile	77
Maximum	90
Range	93.13
Interquartile range (IQR)	28

Descriptive statistics

Standard deviation	18.55365283
Coefficient of variation (CV)	0.4138642785
Kurtosis	-0.6536845854
Mean	44.83028325
Median Absolute Deviation (MAD)	14
Skewness	0.1601038
Sum	49086246.19
Variance	344.2380335
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
50	24179	2.2%
47	24000	2.2%
48	23932	2.2%
49	23853	2.2%
51	22978	2.1%
46	22194	2.0%
52	21734	2.0%
31	21586	2.0%
30	21552	2.0%
44	21247	1.9%
Other values (85)	867680	79.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-3.13	1	< 0.1%
-1.72	1	< 0.1%
0.01	1	< 0.1%
0.42	1	< 0.1%
0.61	1	< 0.1%
1	1	< 0.1%
2	6	< 0.1%
3	192	< 0.1%
4	1502	0.1%
5	3004	0.3%

Value	Count	Frequency (%)
90	3766	0.3%
89	1171	0.1%
88	1738	0.2%
87	1811	0.2%
86	2538	0.2%
85	3324	0.3%
84	3613	0.3%
83	4076	0.4%
82	4424	0.4%
81	5115	0.5%

bp_systolic
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	191
Distinct (%)	0.3%
Missing	1027569
Missing (%)	93.8%
Infinite	0
Infinite (%)	0.0%
Mean	128.3093524

Minimum	10
Maximum	250
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	10
5-th percentile	100
Q1	116
median	127
Q3	140
95-th percentile	159
Maximum	250
Range	240
Interquartile range (IQR)	24

Descriptive statistics

Standard deviation	18.45413998
Coefficient of variation (CV)	0.1438253692
Kurtosis	1.630997318
Mean	128.3093524
Median Absolute Deviation (MAD)	12
Skewness	0.3004511431
Sum	8644586
Variance	340.5552823
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
120	2738	0.3%
110	2487	0.2%
130	2054	0.2%
122	2023	0.2%
124	1806	0.2%
128	1795	0.2%
132	1688	0.2%
118	1674	0.2%
112	1545	0.1%
126	1507	0.1%
Other values (181)	48056	4.4%
(Missing)	1027569	93.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
10	4	< 0.1%
11	14	< 0.1%
12	6	< 0.1%
14	1	< 0.1%
15	3	< 0.1%
16	7	< 0.1%
17	1	< 0.1%
18	4	< 0.1%
24	1	< 0.1%
26	2	< 0.1%

Value	Count	Frequency (%)
250	1	< 0.1%
248	1	< 0.1%
245	2	< 0.1%
240	2	< 0.1%
234	1	< 0.1%
230	1	< 0.1%
229	1	< 0.1%
227	1	< 0.1%
225	1	< 0.1%
224	1	< 0.1%

bp_diastolic
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	122
Distinct (%)	0.2%
Missing	1027573
Missing (%)	93.8%
Infinite	0
Infinite (%)	0.0%
Mean	74.53116419

Minimum	0
Maximum	173
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	0
5-th percentile	58
Q1	67
median	74
Q3	81
95-th percentile	93
Maximum	173
Range	173
Interquartile range (IQR)	14

Descriptive statistics

Standard deviation	10.86601368
Coefficient of variation (CV)	0.1457915464
Kurtosis	0.9619839874
Mean	74.53116419
Median Absolute Deviation (MAD)	7
Skewness	0.3035477067
Sum	5021090
Variance	118.0702532
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
70	3725	0.3%
80	3628	0.3%
72	2826	0.3%
69	2793	0.3%
74	2677	0.2%
78	2670	0.2%
68	2596	0.2%
76	2546	0.2%
67	2477	0.2%
82	2409	0.2%
Other values (112)	39022	3.6%
(Missing)	1027573	93.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
7	1	< 0.1%
9	1	< 0.1%
12	2	< 0.1%
14	1	< 0.1%
16	1	< 0.1%
18	2	< 0.1%
19	1	< 0.1%
24	1	< 0.1%
25	1	< 0.1%

Value	Count	Frequency (%)
173	1	< 0.1%
164	1	< 0.1%
146	1	< 0.1%
143	1	< 0.1%
142	1	< 0.1%
141	1	< 0.1%
139	1	< 0.1%
138	1	< 0.1%
134	2	< 0.1%
133	1	< 0.1%

temperature
Real number (ℝ_≥0)

MISSING

Distinct	156
Distinct (%)	0.3%
Missing	1038715
Missing (%)	94.9%
Infinite	0
Infinite (%)	0.0%
Mean	97.43807192

Minimum	78.08
Maximum	106.16
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	78.08
5-th percentile	95.7
Q1	96.8
median	97.5
Q3	98.1
95-th percentile	99.14
Maximum	106.16
Range	28.08
Interquartile range (IQR)	1.3

Descriptive statistics

Standard deviation	1.087830855
Coefficient of variation (CV)	0.01116433068
Kurtosis	6.156666997
Mean	97.43807192
Median Absolute Deviation (MAD)	0.7
Skewness	-0.3700511841
Sum	5478650.47
Variance	1.18337597
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
97.7	4105	0.4%
96.8	4001	0.4%
97.52	2886	0.3%
97.16	2885	0.3%
97.88	2762	0.3%
97.34	2701	0.2%
98.06	2553	0.2%
96.98	2474	0.2%
98.24	2355	0.2%
98.6	2245	0.2%
Other values (146)	27260	2.5%
(Missing)	1038715	94.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
78.08	1	< 0.1%
78.62	1	< 0.1%
79.52	1	< 0.1%
86.72	2	< 0.1%
87.98	1	< 0.1%
90.32	1	< 0.1%
90.5	1	< 0.1%
91.4	1	< 0.1%
91.6	1	< 0.1%
91.76	1	< 0.1%

Value	Count	Frequency (%)
106.16	1	< 0.1%
105.98	1	< 0.1%
104.72	1	< 0.1%
104.54	1	< 0.1%
103.64	1	< 0.1%
103.5	1	< 0.1%
103.46	1	< 0.1%
103.3	1	< 0.1%
103.28	2	< 0.1%
103.1	2	< 0.1%

pulse
Real number (ℝ_≥0)

MISSING

Distinct	144
Distinct (%)	0.2%
Missing	1033939
Missing (%)	94.4%
Infinite	0
Infinite (%)	0.0%
Mean	78.16727046

Minimum	0
Maximum	174
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	0
5-th percentile	57
Q1	68
median	77
Q3	87
95-th percentile	104
Maximum	174
Range	174
Interquartile range (IQR)	19

Descriptive statistics

Standard deviation	14.56003354
Coefficient of variation (CV)	0.186267647
Kurtosis	1.046809655
Mean	78.16727046
Median Absolute Deviation (MAD)	9
Skewness	0.5111758361
Sum	4768438
Variance	211.9945768
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
80	3579	0.3%
72	3122	0.3%
76	3006	0.3%
68	2330	0.2%
84	2020	0.2%
88	1938	0.2%
74	1910	0.2%
70	1831	0.2%
64	1729	0.2%
86	1577	0.1%
Other values (134)	37961	3.5%
(Missing)	1033939	94.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	3	< 0.1%
4	2	< 0.1%
6	2	< 0.1%
7	1	< 0.1%
8	4	< 0.1%
10	2	< 0.1%
11	2	< 0.1%
12	2	< 0.1%

Value	Count	Frequency (%)
174	2	< 0.1%
173	1	< 0.1%
170	1	< 0.1%
168	1	< 0.1%
163	1	< 0.1%
160	2	< 0.1%
158	1	< 0.1%
157	1	< 0.1%
152	3	< 0.1%
151	1	< 0.1%

weight
Real number (ℝ_≥0)

MISSING

Distinct	4535
Distinct (%)	4.9%
Missing	1003189
Missing (%)	91.6%
Infinite	0
Infinite (%)	0.0%
Mean	2967.021848

Minimum	1.76
Maximum	12345.76
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	1.76
5-th percentile	1872.96
Q1	2361.6
median	2839.52
Q3	3428.48
95-th percentile	4514.88
Maximum	12345.76
Range	12344
Interquartile range (IQR)	1066.88

Descriptive statistics

Standard deviation	845.2281299
Coefficient of variation (CV)	0.2848742521
Kurtosis	3.101110209
Mean	2967.021848
Median Absolute Deviation (MAD)	522.08
Skewness	1.115686512
Sum	272233155.6
Variance	714410.5916
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3033.44	208	< 0.1%
2257.44	204	< 0.1%
2292.64	203	< 0.1%
2786.56	191	< 0.1%
3104	191	< 0.1%
2821.76	190	< 0.1%
2363.2	190	< 0.1%
3068.8	188	< 0.1%
2610.24	185	< 0.1%
2680.64	183	< 0.1%
Other values (4525)	89820	8.2%
(Missing)	1003189	91.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1.76	3	< 0.1%
1.92	1	< 0.1%
2.08	3	< 0.1%
2.24	2	< 0.1%
2.4	3	< 0.1%
2.56	1	< 0.1%
2.72	3	< 0.1%
2.88	2	< 0.1%
3.04	2	< 0.1%
3.2	1	< 0.1%

Value	Count	Frequency (%)
12345.76	2	< 0.1%
11746.08	1	< 0.1%
11534.4	1	< 0.1%
10751.39	1	< 0.1%
10638.4	1	< 0.1%
10543.2	1	< 0.1%
10197.44	1	< 0.1%
10179.84	1	< 0.1%
10172.8	1	< 0.1%
10123.52	1	< 0.1%

height
Categorical

HIGH CARDINALITY
MISSING

Distinct	1081
Distinct (%)	2.6%
Missing	1052611
Missing (%)	96.1%
Memory size	8.4 MiB

5' 2.99"	1245
5' 6.92"	1107
5' 4.96"	1098
5' 6.14"	884
5' 8.11"	804
Other values (1076)	37193

Length

Max length	10
Median length	8
Mean length	7.519288465
Min length	5

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	422 ?
Unique (%)	1.0%

Sample

1st row	5' 5.354"
2nd row	5' 5.157"
3rd row	5' 5.5"
4th row	5' 5"
5th row	5' 5.5"

Common Values

Value	Count	Frequency (%)
5' 2.99"	1245	0.1%
5' 6.92"	1107	0.1%
5' 4.96"	1098	0.1%
5' 6.14"	884	0.1%
5' 8.11"	804	0.1%
5' 5.74"	792	0.1%
5' 5"	779	0.1%
5' 7"	768	0.1%
5' 4.17"	762	0.1%
5' 7.71"	759	0.1%
Other values (1071)	33333	3.0%
(Missing)	1052611	96.1%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
5	36873	43.6%
6	5242	6.2%
4	2113	2.5%
2.99	1245	1.5%
2	1202	1.4%
6.92	1107	1.3%
4.96	1099	1.3%
6.14	887	1.0%
0	869	1.0%
8.11	804	0.9%
Other values (874)	33223	39.2%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

respirations
Real number (ℝ_≥0)

MISSING

Distinct	74
Distinct (%)	0.2%
Missing	1064041
Missing (%)	97.2%
Infinite	0
Infinite (%)	0.0%
Mean	16.95291415

Minimum	1
Maximum	186
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	1
5-th percentile	12
Q1	16
median	16
Q3	18
95-th percentile	20
Maximum	186
Range	185
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	4.382240158
Coefficient of variation (CV)	0.2584948004
Kurtosis	492.3767844
Mean	16.95291415
Median Absolute Deviation (MAD)	1
Skewness	17.20909483
Sum	523862
Variance	19.20402881
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
16	15422	1.4%
18	5440	0.5%
20	4098	0.4%
14	2344	0.2%
12	1712	0.2%
24	520	< 0.1%
22	381	< 0.1%
17	254	< 0.1%
15	214	< 0.1%
28	81	< 0.1%
Other values (64)	435	< 0.1%
(Missing)	1064041	97.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	1	< 0.1%
6	1	< 0.1%
8	4	< 0.1%
9	1	< 0.1%
10	36	< 0.1%
11	9	< 0.1%
12	1712	0.2%
13	56	< 0.1%
14	2344	0.2%

Value	Count	Frequency (%)
186	1	< 0.1%
173	1	< 0.1%
169	2	< 0.1%
166	1	< 0.1%
165	1	< 0.1%
161	1	< 0.1%
152	1	< 0.1%
137	1	< 0.1%
134	1	< 0.1%
129	2	< 0.1%

primary_disease_id
Real number (ℝ)

SKEWED

Distinct	1175
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	187.4308703

Minimum	-1
Maximum	238763
Zeros	0
Zeros (%)	0.0%
Negative	1092391
Negative (%)	99.8%
Memory size	8.4 MiB

Quantile statistics

Minimum	-1
5-th percentile	-1
Q1	-1
median	-1
Q3	-1
95-th percentile	-1
Maximum	238763
Range	238764
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	4985.1677
Coefficient of variation (CV)	26.59736729
Kurtosis	1035.713013
Mean	187.4308703
Median Absolute Deviation (MAD)	0
Skewness	30.89429801
Sum	205225932
Variance	24851896.99
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-1	1092391	99.8%
93256	71	< 0.1%
14902	64	< 0.1%
141896	58	< 0.1%
71023	39	< 0.1%
15418	27	< 0.1%
43467	21	< 0.1%
94308	19	< 0.1%
153404	19	< 0.1%
103104	17	< 0.1%
Other values (1165)	2216	0.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-1	1092391	99.8%
920	6	< 0.1%
970	1	< 0.1%
1283	1	< 0.1%
1428	3	< 0.1%
1467	2	< 0.1%
1522	2	< 0.1%
1568	1	< 0.1%
1570	2	< 0.1%
1605	2	< 0.1%

Value	Count	Frequency (%)
238763	1	< 0.1%
238762	1	< 0.1%
238639	1	< 0.1%
238367	1	< 0.1%
238180	1	< 0.1%
237794	1	< 0.1%
237769	1	< 0.1%
237710	1	< 0.1%
237551	1	< 0.1%
233353	1	< 0.1%

inches
Real number (ℝ_≥0)

MISSING

Distinct	1061
Distinct (%)	2.5%
Missing	1052611
Missing (%)	96.1%
Infinite	0
Infinite (%)	0.0%
Mean	66.10251465

Minimum	0.19
Maximum	407.95
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	8.4 MiB

Quantile statistics

Minimum	0.19
5-th percentile	60.23
Q1	63.386
median	66.14
Q3	69
95-th percentile	73
Maximum	407.95
Range	407.76
Interquartile range (IQR)	5.614

Descriptive statistics

Standard deviation	6.254104452
Coefficient of variation (CV)	0.09461220175
Kurtosis	353.925432
Mean	66.10251465
Median Absolute Deviation (MAD)	2.76
Skewness	4.580385401
Sum	2798185.548
Variance	39.11382249
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
62.99	1245	0.1%
66.92	1107	0.1%
64.96	1098	0.1%
66.14	884	0.1%
68.11	804	0.1%
65.74	792	0.1%
65	779	0.1%
67	768	0.1%
64.17	762	0.1%
67.71	759	0.1%
Other values (1051)	33333	3.0%
(Missing)	1052611	96.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.19	1	< 0.1%
0.57	1	< 0.1%
1.18	2	< 0.1%
1.96	6	< 0.1%
2	2	< 0.1%
2.01	1	< 0.1%
2.04	3	< 0.1%
2.08	1	< 0.1%
2.16	5	< 0.1%
2.2	1	< 0.1%

Value	Count	Frequency (%)
407.95	1	< 0.1%
322	1	< 0.1%
246.22	1	< 0.1%
242.12	1	< 0.1%
221	1	< 0.1%
210.78	1	< 0.1%
194.25	1	< 0.1%
181.31	1	< 0.1%
108.38	1	< 0.1%
108.26	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	encounter_id	patient_id	admit_date	discharge_date	department_name	age	bp_systolic	bp_diastolic	temperature	pulse	weight	height	respirations	primary_disease_id	inches
0	571715	50210	2006-10-24 09:19:12.420	2006-10-24 14:30:12.420	ETC	85.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1	880222	656	2005-06-04 03:43:11.053	2005-06-04 07:39:11.053	ETC	24.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
2	992310	822	2008-04-08 17:41:27.283	2008-04-09 01:55:27.283	HOSP DENTISTRY	32.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
3	440151	922	2005-07-11 11:13:16.607	2005-07-11 23:42:16.607	BT4OB-OB GYN CLINIC	33.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
4	925442	1022	2008-01-23 12:43:02.770	NaT	BT4OB-OB GYN CLINIC	27.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
5	761184	1720	2002-10-04 01:32:11.677	2002-10-05 14:09:11.677	7JCE	18.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
6	1017748	1909	2008-08-24 03:48:43.947	2008-08-24 16:56:43.947	RAD GEN	30.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
7	819435	2275	2003-05-27 16:03:41.190	2003-05-27 17:50:41.190	ETC	19.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
8	1084614	2463	NaT	NaT	MAIN OR	25.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
9	56249	3262	2007-05-24 08:50:36.040	NaT	DOL-DEFAULT ORDERING L	22.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN

Last rows

	encounter_id	patient_id	admit_date	discharge_date	department_name	age	bp_systolic	bp_diastolic	temperature	pulse	weight	height	respirations	primary_disease_id	inches
1094932	805227	99996	1986-01-26 14:00:23.010	1986-01-26 14:00:23.010	DOL-DEFAULT ORDERING L	34.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094933	805256	99996	1985-09-22 16:22:23.010	1985-09-22 16:22:23.010	DOL-DEFAULT ORDERING L	34.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094934	805237	99996	1985-12-01 11:21:23.010	1985-12-01 11:21:23.010	DOL-DEFAULT ORDERING L	34.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094935	805163	99996	1989-11-19 19:00:23.010	1989-11-19 19:00:23.010	DOL-DEFAULT ORDERING L	38.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094936	805157	99996	1984-10-26 18:59:23.010	1984-10-26 18:59:23.010	DOL-DEFAULT ORDERING L	33.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094937	805209	99996	1985-03-03 18:56:23.010	1985-03-03 18:56:23.010	DOL-DEFAULT ORDERING L	33.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094938	805246	99996	1985-10-13 20:15:23.010	1985-10-13 20:15:23.010	DOL-DEFAULT ORDERING L	34.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094939	805197	99996	1985-06-23 16:47:23.010	1985-06-23 16:47:23.010	DOL-DEFAULT ORDERING L	33.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094940	805184	99996	1987-02-27 19:02:23.010	1987-02-27 19:02:23.010	DOL-DEFAULT ORDERING L	35.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN
1094941	805187	99996	1985-09-13 19:06:23.010	1985-09-13 19:06:23.010	DOL-DEFAULT ORDERING L	34.0	NaN	NaN	NaN	NaN	NaN	None	NaN	-1	NaN

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows